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(54) Halftoning processing 

(57) A process and apparatus improve color half- 
tone imaging for ink-based printing by reducing the 
amount of time necessary to perform the halftoning 
process (270), by reducing the amount of ink consumed 
and by increasing the quality of the images (280) pro- 
duced. These benefits are achieved by adapting Image 
Resolution Enhancement Technology (I RET) to render 
color images that achieve near-photographic image 
quality on a color inkjet printer having multiple dye load 
and increased scan axis addressability, while keeping 
the computation complexity to a minimum. This is 
achieved by designing basic patterns at multiple inten- 
sities, and by using a multi-level halftoning technique to 
obtain smooth gradations. For plain paper, as well as for 
coated paper, multi-level halftoning is performed on an 
asymmetric geometry to yield the best result, while for 
glossy paper, a regular geometry yields the best result 
because of the limited ink absorption capacity for glossy 
paper. Further benefits are achieved through non-pri- 
mary color ink reduction and the use of assymetric dither 
matrices. Thus, the method and apparatus of the 
present invention will yield images that have few unde- 
sirable artifacts such as banding, texturing and "worms". 
Furthermore, a reduced amount of processing time will 
be required to render an image and a modest amount 
of ink will be used. Besides decreasing the cost of print- 
ing, the use of a lower amount of ink can cause de- 
creased dry time for each print, and can reduce curling 
of the paper, and smudging of the image. 
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Description 

[0001] The present invention relates to halftoning of a color continuous tone image, for example, to processing color 
continuous-tone images into halftone images for ink-based printing. 

[0002] A color inkjet printer has the capability to render an image with color dots that are either bi-level or multi-level 
in intensity. Color dots of various intensities can be generated by using multiple chambers in print heads, each loading 
color inks with a different dye load. One example of such a printing system employs regular dye-load cyan, magenta, 
yellow, and black inks, and reduced dye-load cyan and magenta inks. 

[0003] A printer can also achieve a higher scan axis printing resolution by increasing the firing frequency relative to 
the cartridge speed. Because the printer dot size remains the same, this is often referred to as the printer addressability. 
For example, a 300 dpi (dot per inch) printer can have the addressability of 600 x 300 dpi. 

[0004] Image Resolution Enhancement Technology (I RET) includes two components: a multi-level halftoning algo- 
rithm, and basic pattern design. The multi-leveling halftoning algorithm is a general halftoning method, while the basic 
pattern design is more device specific. I RET has been successfully implemented in the Hewlett-Packard Color LaserJet 
laser printer. See, Q. Lin, Methods to Print N-Tone Images with Multi-leveling Techniques, U.S. patent application 
08/205,672, filed March 2, 1 994, HP Docket 1093765-1 ; Q. Lin, Printing N-Tone Images with Imperceptible Dots, U.S. 
patent number 5,615,021 , issued March 21 , 1997, HP Docket 1094347-1 ; Q. Lin, B. Hoffmann, and J. Trask, Resolution 
Enhancement Procedure and Apparatus for a Color Laser Printer, U.S. patent application 08/788,767, filed January 
24, 1997, HP Docket 10960458-1. 

[0005] It is desirable to develop a halftoning method for rendering a color image that achieves near-photographic 
image quality on a color inkjet printer having multiple dye loads and increased scan axis addressability. However, as 
will be discussed below in greater detail, one cannot readily extend the I RET to a dual-dye load inkjet printer. A standard 
application of IRET to a dual-dye load inkjet printer will yield images that have undesirable artifacts such as banding, 
texturing and "worms". Furthermore, a large amount of processing time will be required to render an image and an 
25 inordinate amount of ink will be used. Besides increasing the cost of printing, the use of excessive ink can cause 
additional undesirable effects such as an increased dry time for each print, curling of the paper, and smudging of the 
image. 

[0006] Thus, it can be seen that physical properties of ink-based printing impose cost, output speed, and image 
fidelity limits upon ink-based color halftone image output devices, and hinder the use of these devices in many appli- 
30 cations. 

[0007] Therefore, there is an unresolved need for a technique that can improve color halftone imaging for ink-based 
printing by reducing the amount of time necessary to perform the halftoning process, by reducing the amount of ink 
consumed and by increasing the quality of the images produced. 
[0008] The present invention seeks to provide improved halftoning of an image. 
35 [0009] According to an aspect of the present invention there is provided a process of halftoning a color continuous 
tone image as specified in claim 1 . 

[0010] According to another aspect of the present invention there is provided a processor for halftoning a color 
continuous tone image as specified in claim 9. 

[001 1] A preferred process and apparatus are described below to improve color halftone imaging for ink-based print- 
ing by reducing the amount of time necessary to perform the halftoning process, by reducing the amount of ink con- 
sumed and by increasing the quality of the images produced. These benefits are achieved by adapting Image Resolution 
Enhancement Technology (IRET) to render color images that achieve near-photographic image quality on a color inkjet 
printer having multiple dye load and increased scan axis addressability. 

[0012] We describe a method for rendering a color image on a dual dye-load inkjet printer with a near-photographic 
quality, while keeping the computation complexity toa minimum. This is achieved by designing basic patterns at multiple 
intensities, and by using a multi-level halftoning technique to obtain smooth gradations. For plain paper, as well as for 
coated paper, multi-level halftoning is performed on an asymmetric geometry to yield the best result, while for glossy 
paper, a regular geometry yields the best result because of the limited ink absorption capacity for glossy paper. Further 
benefits are achieved through non-primary color ink reduction and the use of asymmetric dither matrices. 
so [001 3] Thus, the preferred method and apparatus will yield images that have few undesirable artifacts such as band- 
ing, texturing and "worms". Furthermore, a reduced amount of processing time will be required to render an image and 
a modest amount of ink will be used. Besides decreasing the cost of printing, the use of a lower amount of ink can 
cause decreased dry time for each print, and can reduce curling of the paper, and smudging of the image. 
[0014] An embodiment of the present invention is described below, by way of example only, with reference to the 
55 accompanying drawings, in which: 

Figure 1 is a drawing illustrating the Multi-level Halftoning Principle; 

Figure 2 is a drawing illustrating an Image Resolution Enhancement Technology color halftoning technique modified 
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to accommodate the special needs of a color inkjet printer having multiple dye load and increased scan axis ad- 
dressability; and 

Figure 3 is a drawing illustrating representation of the lightness values for the basic pattern of dual-lye load cyan ink. 

s [0015] Embodiments of the invention are discussed below with reference to Figures 1-3. Those skilled in the art will 
readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes, 
however, because the invention extends beyond these limited embodiments. 

[0016] The following describes a halftoning method and apparatus for rendering a color image that achieves near- 
photographic image quality on a color inkjet printer having multiple dye load and increased scan axis addressability. 

10 

Image Resolution Enhancement Technology 



[0017] Image Resolution Enhancement Technology (I RET) includes two components: a multi-level halftoning algo- 
rithm, and basic pattern design. The multi-leveling halftoning algorithm is a general halftoning method, while the basic 
is pattern design is more device specific. As mentioned previously, I RET has been successfully implemented in the 
Hewlett-Packard Color LaserJet laser printer The preferred embodiment extends IRET to a dual-dye load inkjet printer. 
For continuity, we will review the multi-level halftoning algorithm in IRET, and then describe how to apply it to the dual 
dye-load inkjet printer that has increased scan axis addressability. 

[0018] The multi-level halftone algorithm was developed to halftone any set of input numbers to any smaller set of 
20 output numbers. When there are several intensity levels to halftone into, it is possible to create a gray scale impression 
with dots at different intensity levels. This gives one more degree of freedom: not only can one select the arrangement 
of dots, but also which two dot intensities to use. It is preferable to select printer dots at two output gray levels closest 
to the input to perform spatial modulation. This will result in lowest pattern texture. 

[001 9] To illustrate this with an example, Figure 1 is a drawing illustrating the Multi-level Halftoning Principle. Suppose 
25 W e have 4 output levels with gray levels of 0, 80, 1 30, and 255, as shown in Figure 1 . Then any input data in the range 
of 0 to 80 belongs to interval 1 , and will be halftoned using output levels 0 and 1 . Similarly, any input data in the range 
of 81 to 1 30 belongs to interval 2, and will be halftoned using output levels 1 and 2. Finally, any input data in the range 
of 1 31 to 255 belongs to interval 3, and will be halftoned using output levels 2 and 3. For a gray patch with input gray 
level x that belongs in interval k, exactly how many pixels will take output level k and k + 1 respectively, and how they 
30 will be distributed spatially, depends on the dither matrix employed. 

[0020] To generate visually pleasing patterns, because the printing dots are typically large enough to be perceived 
as dots, the printing dots should be maximally dispersed when rendering a continuous tone image. Dispersing them 
will create a dot arrangement with the least perceptually detectable structure. One method of generating a halftone 
image with maximally dispersed dots is described in a US patent. See, Q. Lin, Halftone Images Using Special Filters, 
35 US Patent 5,317,418, issued May 31, 1 994, HP docket 1093443-1. For a color printer, it is further desirable for color 
dots to be maximally dispersed and to be dispersed with the least perceptually detectable changes in both hue and 
intensity. One method for generating such a halftone image is described in a US patent application. See, Q. Lin and 
J. P. Allebach, Joint Design of Dither Matrices for a Set of Colorants, U.S. patent application 08/641304, filed April 30, 
1996. 

40 [0021] Similar reasoning also applies to a multi-level printer. Hence, it is desirable to use a set of matrices jointly 
designed for primary colors in conjunction with the multi-level halftoning algorithm. 

[0022] In general, suppose there are K output levels 1,2,..., K corresponding to non-uniformly spaced gray levels 
N p N 2 N K , with AT, < N 2 <... N K , and the input gray scale range is from to N K . Then according to this scheme, any 
input gray patch with gray level between N K and A/ K+1 will be rendered using printer dots at intensity levels N K andN k+1 . 
45 [0023] To render input x(m, n) at pixel position (m, n), the corresponding element t(m, n) in a halftone matrix is scaled 
to the region [N K , N k+1 ], and compared with x(m, n). Let V k (m, n) be the scaled-down matrix: 

N K + 1~ N K 

t k (m,n)=t k (m,n)X K+1 , 

SO /V K /V 1 

then the output y(m, n) at pixel position (m, n) is 

55 f k + 1 if t\(m. n) + N K <x < N K+ , 

y(m, n) = 1 

Kk if Ng < x < = t\(m. n) + N K 
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[0024] Figure 2 is a drawing illustrating an Image Resolution Enhancement Technology color halftoning technique 
200 modified according to the preferred embodiment to accommodate the special needs of a color Inkjet printer that 
has multiple dye loads and increased scan axis addressability. 

[0025] To perform multi-level halftoning using the basic algorithm, we can first compare the input data (210) with the 
s output gray levels (220) to determine (240) the interval into which the data falls, and then store it in a look-up table 
lut v This would require 256 bytes. We can also store the result of scaling a dither matrix threshold (250) for each 
interval in a second look-up table lut 2 . This would require 256K bytes : where K is the total number of output levels. In 
addition, one can also store the M X M dither matrix, which requires MX Mbytes. 

[0026] For example, if we have 16 output levels, and we use a 16 X 16 dither matrix, then the total amount of ROM 
to needed is 4.6k bytes. 

[0027] Let x(m, n) be the input pixel, and t(m, n) be the dither matrix threshold at the current pixel (m n) then the 
output pixel y(m, n) is obtained (260) using 

is k= lut^xfm, n)] 



(k + 1 if x(m, n) > + lut 2 \k\\t(m, n)] 
20 y(m, n) = \ 

I k else 

The computation required per pixel is then 2 table look-ups, 1 comparison, and 0 to 1 addition. The resulting halftone 
25 image (270) can then be printed or displayed (280). 

Applying IRET to Dual Dye-Load Inkjet Printer 
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[0028] Halftoning for a dual dye-load printer can be achieved by converting the problem into a multi-level halftoning 
problem. Because the dual dye-load printing system has four primary colors, cyan, magenta yellow and black one 
preferably first to converts (230) RGB to CMYK. The cyan and magenta color can then be rendered using the regular 
dye-load ink and the reduced dye-load ink, depending on the cyan and magenta levels, respectively. For example 
light tone regions will be rendered using the low dye-load ink, while midtone regions will be rendered with a mixture of 
reduced dye-load ink and regular dye-load ink, with the amount of regular dye-load ink increasing toward the dark tone 
regions. Moreover, we have complete control over the placement of the dots to minimize overlap, thus reducing halftone 
texture. For example, after we achieve 1 00% coverage of the low dye-load ink, we gradually replace low dye-load dots 
with regular dye-load dots, while maintaining 100% ink coverage. 

[0029] Utilizing the increased scan axis addressability in conjunction with the dual dye-load inks, it is possible to 
achieve near photographic image quality on a low cost Inkjet printer. Two embodiments : will be discussed next. 

First embodiment: using 300x600 geometry to obtain more levels 

[0030] We can use the increased scan axis resolution to obtain more levels. Using the 300x600 dpi mode, it is 
possible to get a maximum of 8 basic output levels lor cyan and magenta, not including white, on the 300x300 dpi grid 
These are 1L, 2L, ID, 1D1L, 1D2L, 2D, 2D1L, 2D2L, where 1D stands for one dark drop, 1L stands for 1 light drop 
and so on. Figure 3 is a representation of the lightness (/_*) values for the basic patterns of cyan ink according to an 
embodiment of the present invention. However, as shown in Figure 3 : which plots the L* for the basic output levels of 
cyan : 2D1 L, 2D2L are actually lighter than 2D on both the plain paper and the coated paper. Levels 1 D end 1 D1 L have 
similar darkness as 1 D2L, but much worse banding. So, for one embodiment only 4 levels were selected for cyan and 
magenta: 1L, 2L, 1D2L : and 2D. 

[0031] The halftoning strategies mentioned above that worked very well on plain paper and coated paper resulted 
in too much ink on glossy paper. After some experimentation, we found that using only 1 light drop (1 L) or 1 dark drop 
(1 D) for cyan and magenta (tri-level), and 1 drop of yellow (bi-level) on the 300x300 dpi grid gives good resufts. 
[0032] It is important to realize that by selecting the appropriate basic patterns, it is possible to achieve ink limiting, 
so that ink can be absorbed by the paper without problems. To have more flexible and accurate control, we can, in 
addition, perform a color decomposition, and calculate the amount of primary colors, secondary colors, and tertiary 
colors, and limit the maximum amount of each color to the appropriate amount. As an example, secondary colors, such 
as blue, may need more reduction. 
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[0033] For example, suppose the red, green, and blue components of a pixel are 30, 50, 40. Then the cyan, magenta, 
and yellow amounts will be 255 -30 = 225, 255 - 50= 205, and 255 - 40 = 215, respectively. The amount of tertiary 
color is min (225, 205, 215) = 205. The amount of secondary color (green) is med (225, 205, 215) - min (225, 205, 
215) = 215 - 205 = 10. The amount of primary color (magenta) is max (225, 205, 215) - min (225, 205, 215) = 225 - 
5 205 = 10. We can reduce each of the tertiary, secondary and primary colors by a different percentage. For example, 
we can reduce the amount of tertiary color by 20% to 205 x 0.8 = 1 64, we can reduce the amount of secondary color 
(green) by 1 0% to 1 0 x 0.9 = 9, and make no adjustment to the primary color cyan. After these ink limiting computations 
the final cyan amount is 1 64 + 9 + 1 0 = 1 83, the final magenta amount is 1 64, and the final yellow amount is 1 64 + 9 = 1 73. 

io Second Embodiment: asymmetric halftoning on 300x600 geometry 

[0034] In the first embodiment, halftoning was performed on the 300x300 dpi grid. The 300x600 dpi mode is used, 
but dots are combined to form more levels on the 300x300 dpi grid. This is similar to the I RET approach for the Color 
LaserJet laser printer. See,Q. Lin, B. Hoffmann, and J. Trask, U.S. patent application 08/788,767, filed January 24, 

is 1997, HP Docket 10960458. Alternatively, halftoning can be performed on the 300x600 dpi grid, resulting in tri-level 
halftoning on cyan and magenta (white, 1 light drop, 1 dark drop), and bi-level halftoning on yellow and black. 
[0035] There are two advantages associated with using asymmetric halftoning. First, there is less banding. Super- 
pixeling is more susceptible to banding in some regions, for example, in the lighter neutral tone region. Secondly, the 
texture in asymmetric halftoning is more consistent. For example, there is no change in texture in the transition area 

20 between 1 light drop and 2 light drops in the cyan and magenta ramps. 

[0036] When performing asymmetric halftoning on the 300x600 dpi grid, a dither matrix designed for regular printing 
geometry will be compressed in one direction, resulting in 'worm- like patterns in the highlight region. The effect is 
subtle but noticeable. This problem can be solved by designing a set of dither matrices for the 300x600 dpi geometry. 
For stochastic dither matrices such as those described in Lin and Allebach, U.S. patent application 08/641 304, filed 

2S April 30, 1996, supra, and in Q. 

[0037] Lin, US Patent 5,31 7,41 8, issued May 31 , 1994, supra, the widths of the filters in the matrix design are adjusted 
to compensate for the space compression in the paper advance direction. For example, the filter width in the scan 
direction, where the addressability is higher (600 dpi), can be set as twice the filter width in the paper advance direction. 
[0038] Observe that on a ramp from white to full magenta, the density of low dye-load magenta dots gradually in- 

30 creases, until 100% coverage is attained. Then the low dye-load dots are gradually replaced by the high dye-load dots 
while the ink coverage remains at 1 00%. This ensures that the visibility of halftone texture is minimal, and coalescence 
of ink drops is also minimal. 

[0039] In asymmetric halftoning, the source image is kept at 300x300 dpi while the output bitmap is 600x300 dpi. 
Let x(m, n) be the input pixel, and t(m, n) be the dither matrix threshold at the current pixel (m, n), then the output pixel 
35 y(m, n) is obtained using 

k- lui^xfm, n)] 

40 

( k + 1 \fx(m. n) > lut 2 [k}[t(2m, n)] 

y(2m t n) = i 
45 I k else 

( k + 1 ifx(m, n) > lia,[k][i(2m + 1, n)] 
50 y(2m + 7, n) =i 

I k else 

[0040] Note that it is also possible to scale the source image to 300x600 dpi resolution. However, because the dot 
55 size is still at 300 dpi, the extra computation may not be warranted. 
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[0041] We described a method for rendering a color image on a dual dye-load Inkjet printer with a near-photographic 
quality, while keeping the computation complexity toa minimum. This is achieved by designing basic patterns at multiple 
intensities, and by using a multi-level halftoning technique to obtain smooth gradations. For plain paper, as well as for 
coated paper, multi-level halftoning is performed on an asymmetric geometry to yield the best result, while for glossy 
paper, a regular geometry yields the best result because of the limited ink absorption capacity for glossy paper. 
[0042] The disclosures in United States patent application no. 08/921 ,891 , from which this application claims priority, 
and in the abstract accompanying this application are incorporated herein by reference. 



Claims 

1 - A process of halftoning a color continuous tone image to form a halftone image, the process comprising the steps of: 

for at least one color, extracting the color information for the selected color from the color continuous tone 
image; and 

performing a multi-level halftoning for the selected color wherein the multiple levels are chosen such that when 
printing a tone ramp for the selected color, light tone regions are rendered using a low dye-load ink, while 
midtone regions are rendered with a mixture of the low dye-load ink and a regular dye-load ink, with the regular 
dye-load ink amount increasing toward dark tone regions. 

2. The process as set forth in 1 , wherein the multiple levels are chosen such that when printing the toner ramp for 
the selected color, after substantially full coverage of the low dye-load ink is achieved, low dye-load dots are 
gradually replaced with regular dye-load dots, while maintaining the substantially full coverage. 

3. The process as set forth in 1 or 2, wherein the multiple levels are chosen based upon characteristics of a target 
print medium. 

30 4. The process as set forth in 1 , 2 or 3, comprising the steps of: 

performing a color decomposition into primary and non-primary colors; and 

limiting the maximum amount of primary and non-primary colon to achieve ink limiting. 

55 5. The process as set forth in 1 to 4, wherein the multi-level halftoning is performed on an asymmetric geometry. 

6. The process as set forth in 1 to 4, wherein the multi-level halftoning is performed on a symmetric geometry. 

7. The process as set forth in 1 to 4, wherein the multi-level halftoning is performed using an asymmetric dither matrix. 

8. The process as set forth in 1 to 4, wherein the multi-level halftoning is performed using a symmetric dither matrix. 

9. A processor for halftoning a color continuous tone image to form a halftone image according to any of the processes 
set forth in 1 to 8, the processor comprising: 



for at least one color, means for extracting the color information for the selected color from the color continuous 
tone image; and 

means for performing a multi-level halftoning for the selected color wherein the multiple levels are chosen 
such that when printing a tone ramp for the selected color, light tone regions are rendered using a low dye- 
load ink, while midtone regions are rendered with a mixture of the low dye-load ink and a regular dye-load ink, 
with the regular dye-load ink amount increasing toward dark tone regions. 

10. The processor as set forth in 9, comprising: 

means for performing a color decomposition into primary and non-primary colors; and 

means for limiting the maximum amount of primary and non-primary colors to achieve ink limiting. 
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(54) Halftoning processing 

(57) A process and apparatus improve color half- 
tone imaging for ink-based printing by reducing the 
amount of time necessary to perform the halftoning 
process (270), by reducing the amount of ink consumed 
and by increasing the quality of the images (280) pro- 
duced. These benefits are achieved by adapting Image 
Resolution Enhancement Technology (I RET) to render 
color images that achieve near-photographic image 
quality on a color inkjet printer having multiple dye load 
and increased scan axis addressability, while keeping 
the computation complexity to a minimum. This is 
achieved by designing basic patterns at multiple inten- 
sities, and by using a multi-level halftoning technique to 
obtain smooth gradations. For plain paper, as well as for 
coated paper, multi-level halftoning is performed on an 
asymmetric geometry to yield the best result, while for 
glossy paper, a regular geometry yields the best result 
because of the limited ink absorption capacity for glossy 
paper. Further benefits are achieved through non-pri- 
mary color ink reduction and the use of assymetric dither 
matrices. Thus, the method and apparatus of the 
present invention will yield images that have few unde- 
sirable artifacts such as banding, texturing and "worms". 
Furthermore, a reduced amount of processing time will 
be required to render an image and a modest amount 
of ink will be used. Besides decreasing the cost of print- 
ing, the use of a lower amount of ink can cause de- 
creased dry time for each print, and can reduce curling 
of the paper, and smudging of the image. 
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